Qualitative Dimensions in Question Answering: Extending the Definitional QA Task
نویسندگان
چکیده
Current question answering tasks handle definitional questions by seeking answers which are factual in nature. While factual answers are a very important component in defining entities, a wealth of qualitative data is often ignored. In this incipient work, we define qualitative dimensions (credibility, sentiment, contradictions etc.) for evaluating answers to definitional questions and we explore potential benefits to users. These qualitative dimensions are leveraged to uncover indirect and implicit answers and can help satisfy the user’s information need.
منابع مشابه
Definitional Question-Answering Using Trainable Text Classifiers
Automatic question answering (QA) has gained increasing interest in the last few years. Question-Answering systems return an answer rather than a document. Definitional questions are questions such as Who is Alexander Hamilton? or what are fractals? Looking at logs of web search engines definitional questions occur quite frequently, suggesting it is an important type of questions. Analysis of p...
متن کاملTALP-UPC at TREC 2005: Experiments Using a Voting Scheme Among Three Heterogeneous QA Systems
This paper describes the experiments of the TALPUPC group for factoid and ’other’ (definitional) questions at TREC 2005 Main Question Answering (QA) task. Our current approach for factoid questions is based on a voting scheme among three QA systems: TALP-QA (our previous QA system), Sibyl (a new QA system developed at DAMA-UPC and TALP-UPC), and Aranea (a web-based data-driven approach). For de...
متن کاملA Hybrid Approach for QA Track Definitional Questions
We present an overview of DefScriber, a system developed at Columbia University that combines knowledge-based and statistical methods to answer definitional questions of the form, “What is X?” We discuss how DefScriber was applied to the definition questions in the TREC 2003 QA track main task. We conclude with an analysis of our system’s results on the definition questions.1
متن کاملInvestigating Embedded Question Reuse in Question Answering
The investigation presented in this paper is a novel method in question answering (QA) that enables a QA system to gain performance through reuse of information in the answer to one question to answer another related question. Our analysis shows that a pair of question in a general open domain QA can have embedding relation through their mentions of noun phrase expressions. We present methods f...
متن کاملA Comparative Study on Sentence Retrieval for Definitional Question Answering
Most definitional question answering (QA) systems integrate statistical ranking using Web and WordNet as external resources and pattern matching to retrieve relevant sentences for further processing. We examine the impact of using these two common resources in answering definition questions by varying the use of WordNet and two types of Web resources in statistical ranking, and definition patte...
متن کامل